Nice Perfume. How Long Did You Marinate in It? Multimodal Sarcasm Explanation
نویسندگان
چکیده
Sarcasm is a pervading linguistic phenomenon and highly challenging to explain due its subjectivity, lack of context deeply-felt opinion. In the multimodal setup, sarcasm conveyed through incongruity between text visual entities. Although recent approaches deal with as classification problem, it unclear why an online post identified sarcastic. Without proper explanation, end users may not be able perceive underlying sense irony. this paper, we propose novel problem -- Multimodal Explanation (MuSE) given sarcastic containing image caption, aim generate natural language explanation reveal intended sarcasm. To end, develop MORE, new dataset 3510 posts. Each (English) sentence describing hidden We benchmark MORE by employing Transformer-based architecture. It incorporates cross-modal attention in Transformer's encoder which attends distinguishing features two modalities. Subsequently, BART-based auto-regressive decoder used generator. Empirical results demonstrate convincing over various baselines (adopted for MuSE) across five evaluation metrics. also conduct human on predictions obtain Fleiss' Kappa score 0.4 fair agreement among 25 evaluators.
منابع مشابه
How long did it last? You would better ask a human
In the future, human-like robots will live among people to provide company and help carrying out tasks in cooperation with humans. These interactions require that robots understand not only human actions, but also the way in which we perceive the world. Human perception heavily relies on the time dimension, especially when it comes to processing visual motion. Critically, human time perception ...
متن کاملHow did you sleep in the ICU?
illness, as far as quantitative and qualitative sleep depriva tion can have negative consequences on a physiologic function, particularly the immune mechanism, as well as psychological well-being [1]. Patients’ perception of intensive care is very diff erent depending on the study. To illustrate, Simini reported frequent feelings such as ‘pain, noise, sleep deprivation, thirst, hunger, fear, an...
متن کامل"How did you sleep last night? Have you eaten today?".
Correspondence and reprints: Maya Harel-Sterling, McGill University, Montreal, Quebec. E-mail [email protected] Accepted for publication June 24, 2013 Stepping into a stranger’s home on a medical visit was a new and humbling experience. During a recent medical school elective in social paediatrics, I had the opportunity to make several such home visits. It was challenging and e...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i10.21300